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LISTING OF CLAIMS 

The listing of claims provided below replaces all prior versions, and listings, of 
claims in the application. 

5 1. (Currently Amended) An input device for providing a signal to effect one of 

translational movement, rotational movement, and both translational and rotational 
movements of an object on a graphical display, comprising: 
a device for capturing video images; 

an input image processor that translates captured video images of human arm 
10 motion into signals that are delivered to an output image processor, the input image 
processor programmed to (a) isolate a human form from a background in a captured video 
image by comparing the captured video image with subtracting a video image of the 
background without the human form from the captured video image ; (b) determine a 
position and a movement of arms of the human form; and (c) generate an output signal 
15 responsive to one of the position, the movement, and both the position and the movement 
of the human arms; and 

an output image processor that is programmed to effect one of translational 
movement, rotational movement, and both translational and rotational movement of an 
object on a graphical display in response to the signals received from the input image 
20 processor. 

2. (Previously Amended) The input device of claim 1 wherein the 

output image processor changes the graphical display according to a perspective of what a 
flying object would see. 

25 
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3. (Original) The input device of claim 1 wherein the output image 
processor generates a graphical display of a flying object whose position and motion are 
responsive to the signal output by the input image processor. 

4. (Currently Amended) A method for generating signals to effect one of 
translational movement, rotational movement, and both translational and rotational 
movements of an object on a graphical display using human arm position and movement 
data, comprising: 

providing an image processor and a device for capturing video images; 
capturing video images of a background without a human form and a background 
with a human form; 

processing the captur e d video images subtracting the captured video image of the 
background without the human form from the captured video image of the background 
with the human form to isolate the human form from the background; 

isolating arm portions of the human form; 

calculating arm position and movement data; and 

generating a signal responsive to the arm position and movement data for effecting 
one of translational movement, rotational movement, and both translational and rotational 
movements of an object on a graphical display. 

5. (Currently Amended) A method for generating signals using one of human 
arm position data, human arm movement data, and both human arm position and 
movement data, comprising: 

providing an image processor and a device for capturing video images; 
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capturing video images of a background without a human form and a background 
with a human form with the device; 

using the image processor to proc e ss the captured video images subtract the 
captured video image of the background without the human form from the captured video 
5 image of the background with the human form to isolate the human form from the 
background; 

isolating arm portions of the human form from a captured video image using the 
image processor; 

calculating arm position and movement data using the image processor; and 
10 generating a signal responsive to the arm position and movement data using the 

image processor. 

6. (Currently Amended) A method for generating signals to effect one of 
translational movement, rotational movement, and both translational and rotational 
15 movements of an object on a graphical display using one of human arm position data, 
human arm movement data, and both human arm position and movement data, comprising: 
providing an image processor and a device for capturing a video sequence; 
capturing, from the video sequence, a frame that does not include a person; 
isolating a view comprising a foreground subject image view by performing an 
20 algorithm on the video sequence and the frame that does not include the person , wherein 
the algorithm includes subtracting the frame that does not include the person from 
individual frames in the video sequence ; 

determining whether the isolated view includes an image of a person; 
determining a horizontal extent of a torso in the image of the person so as to isolate 
25 arm portions of the person in frames of the captured video sequence; 
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computing arm angles by calculating angles of principle moment of nonzero pixels 
in the arm portions of the image of the person; and 

generating an arm position data signal responsive to arm angles for effecting one of 
translational movement, rotational movement, and both translational and rotational 
5 movement of an object on a graphical display. 

7. (Previously Amended) The method of claim 6 wherein the step of 

determining whether the isolated view includes the image of the person comprises the steps 
of: 

10 counting a total number of nonzero pixels in the foreground image; 

ensuring that the total number of nonzero pixels in the foreground image falls 
within a range defined by a minimum and a maximum threshold number of pixels. 



8. (Cancelled) 

15 

9. (Original) The method of claim 6 wherein the following algorithm is 
used in the isolating step: 

(a) obtain static background Y0 U0 V0 frames; 

(b) smooth images Y0 U0 V0 using a 5x5 Gaussian convolution; 
20 (c) obtain current Y U V video frames; 

(d) smooth images Y U V using a 5x5 Gaussian convolution; 

(e) for each pixel in Y, compute Ydif = abs( Y - Y0); 

(f) for each pixel in U, compute Udif = abs( U - U0); 

(g) for each pixel in V, compute Vdif = abs( V - V0); 

25 (h) for each pixel in Ydif Udif Vdif, compute Sum = Ydif + Udif*8 + Vdif*8; 
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(i) for each pixel in Sum, compute Foreground = 1 if Sum > Threshold, 0 
otherwise; 

(j) erode Foreground using standard erosion morphological filter (to remove any 
single-pixel erroneous measurements, such as caused by salt-and-pepper noise). 

5 

10. (Previously Amended) The method of claim 6 wherein the arm 

position data signal generated in the generating step is selected from the group consisting 
of signals related to object airspeed acceleration, bank angle, and pitch angle. 

10 11. (Previously Amended) The method of claims 6 wherein the arm 

position data signal generated in the generating step is determined with the inclusion of 
smoothing constants. 

12. (Currently Amended) A method for generating signals for use in a flight 
15 simulator graphical display using human arm position data to effect one of translational 
movement, rotational movement, and both translational and rotational movement, 
comprising: 

providing a device for capturing video images and an image processor; 
capturing video images with the device, the video images including an image of a 
20 background without a human form and an image of a background with a human form; 

using the image processor to proc e ss the captured video images subtract the image 
of the background without the human form from the image of the background with the 
human form to isolate the human form from the background; 

isolating arm portions of the human form from a captured video image using the 
25 image processor; 
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calculating arm position and movement data using the image processor; and 
generating a signal responsive to the arm position and movement data using the 
image processor for use in generating a state of a flight simulator graphical display. 

5 13. (Original) The method of claim 12 wherein the flight simulator 

graphical display includes as an object a flying creature that moves wings. 

14. (Original) The method of claim 12 wherein the flight simulator 
graphical display depicts a change in perspective of what a flying creature would see. 

10 

15. (Previously Amended) The method of claim 13 further including a 
step of generating flapping noises corresponding to movement of the wings of the flying 
creature. 

15 16. (Previously Amended) The method of claim 15 wherein a volume of 

the flapping noises increases with an increased rate of arm motion. 

17. (Previously Amended) The method of claims 15 wherein the flapping 
noises are triggered when a signed time rate of change of an average of arm angles exceeds 

20 a pre-determined threshold. 

18. (Currently Amended) An article of manufacture embodying a program of 
instructions executable by a machine, the program of instructions including instructions 
for: 

25 capturing video images; 
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processing the captured video images to subtract a background from the captured 
video images to isolate a human form from the a background; 
isolating arm portions of the human form; 

calculating arm position and movement data, wherein the calculating includes 
5 calculating angles of principle moment of the arm portions of the human form; and 

generating a signal responsive to the arm position and movement data for effecting 
one of translational movement, rotational movement, and both translational and rotational 
movement of an object on a graphical display. 

10 19. (Previously Amended) The article of manufacture of claim 18 

wherein the signal generated by the program of instructions is used to generate a state of a 
flight simulator graphical display. 

20. (Currently Amended) An article of manufacture embodying a program of 
15 instructions executable by a machine, the program of instructions including instructions 
for: 

capturing video images with a device, the video images including an image of a 
background without a human form and an image of a background with a human form; 

using an image processor to process tho captured video images subtract the image 
20 of the background without the human form from the image of the background with the 
human form to isolate the human form from the background; 

isolating arm portions of the human form from a captured video image using the 
image processor; 

calculating arm position and movement data using the image processor; and 
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generating a signal responsive to the arm position and movement data using the 
image processor. 

21. (Currently Amended) An article of manufacture embodying a program of 
5 instructions executable by a machine, the program of instructions including instructions 

for: 

capturing, from a video sequence, a frame that does not include a person; 

isolating a view of an image of the person by performing an algorithm on the video 
sequence and the frame that does not include the person , wherein the algorithm includes 
10 subtracting the frame that does not include the person from the video sequence ; 

determining whether the isolated view includes the image of the person; 

determining a horizontal extent of a torso of the person in the image so as to isolate 
arm portions of the person in the image; 

computing arm angles by calculating angles of principle moment of nonzero pixels 
15 in the arm portions of the person in the image; and 

generating one of an arm position data signal, an arm movement data signal, and 
both arm position and movement data signals responsive to the computed arm angles for 
effecting one of translational movement, rotational movement, and both translational and 
rotational movement of an object on a graphical display. 

20 

22. (Currently Amended) A method for generating signals for use in a flight 
simulator graphical display using human arm position data to effect one of translational 
movement, rotational movement, and both translational and rotational movement, wherein 
the flight simulator graphical display includes as an object a flying creature that moves 

25 wings, comprising: 
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providing a device for capturing video images and an image processor; 
capturing video images with the device; 

using the image processor to process subtract a background from the captured video 
images to isolate a human form from the a background; 

isolating arm portions of the human form from a captured video image using the 
image processor; 

calculating arm position and movement data using the image processor; and 
generating a signal responsive to the arm position and movement data using the 

image processor, the signal to be used in generating a state of the flight simulator graphical 

display. 

23. (Previously Added) The method of claim 22 further including a step of 
generating flapping noises corresponding to a movement of the wings of the flying 
creature. 

24. (Previously Added) The method of claim 23 wherein a volume of the 
flapping noises increases with an increased rate of arm motion. 

25. (Previously Added) The method of claim 23 wherein the flapping noises 
are triggered when a signed time rate of change of an average of calculated arm angles 
exceeds a pre-determined threshold. 

26. (Currently Amended) A method for generating signals for use in a flight 
simulator graphical display using human arm position data to effect one of translational 
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movement, rotational movement, and both translational and rotational movement, 
comprising: 

providing a device for capturing video images and an image processor; 
capturing video images with the device; 

using the image processor to process subtract a background from the captured video 
images to isolate a human form from the a background; 

isolating arm portions of the human form from a captured video image using the 
image processor; 

calculating arm position and movement data using the image processor; and 
generating a signal responsive to the arm position and movement data using the 
image processor, the signal to be used in generating a state of the flight simulator graphical 
display, wherein the flight simulator graphical display depicts a change in perspective of 
what a flying creature would see. 

27. (New) A method for generating signals to effect one of translational 
movement, rotational movement, and both translational and rotational movements of an 
object on a graphical display using one of human arm position data, human arm movement 
data, and both human arm position and movement data, comprising: 

providing an image processor and a device for capturing a video sequence; 

capturing, from the video sequence, a frame that does not include a person; 

isolating a view comprising a foreground subject image view by performing an 
algorithm on the video sequence and the frame that does not include the person; 

determining whether the isolated view includes an image of a person by counting a 
total number of nonzero pixels in the foreground image and ensuring that the total number 
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of nonzero pixels in the foreground image falls within a range defined by a minimum and a 
maximum threshold number of pixels; 

determining a horizontal extent of a torso in the image of the person so as to isolate 
arm portions of the person in frames of the captured video sequence; 
5 computing arm angles by calculating angles of principle moment of nonzero pixels 

in the arm portions of the image of the person; and 

generating an arm position data signal responsive to arm angles for effecting one of 
translational movement, rotational movement, and both translational and rotational 
movement of an object on a graphical display. 

10 

28. (New) A method for generating signals to effect one of translational 
movement, rotational movement, and both translational and rotational movements of an 
object on a graphical display using one of human arm position data, human arm movement 
data, and both human arm position and movement data, comprising: 
15 providing an image processor and a device for capturing a video sequence; 

capturing, from the video sequence, a frame that does not include a person; 

isolating a view comprising a foreground subject image view by performing an 
algorithm on the video sequence and the frame that does not include the person, wherein 
the algorithm includes, 
20 (a) obtaining static background Y0 U0 V0 frames, 

(b) smoothing images Y0 U0 V0 using a 5x5 Gaussian convolution, 

(c) obtaining current Y U V video frames, 

(d) smoothing images Y U V using a 5x5 Gaussian convolution, 

(e) for each pixel in Y, computing Ydif = abs( Y - Y0), 
25 (f) for each pixel in U, computing Udif = abs( U - U0), 
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(g) for each pixel in V, computing Vdif = abs( V - V0), 

(h) for each pixel in Ydif Udif Vdif, computing Sum = Ydif + Udif*8 + 

Vdif*8, 

(i) for each pixel in Sum, computing Foreground = 1 if Sum > Threshold, 0 
5 otherwise, 

(j) eroding Foreground using standard erosion morphological filter to 
remove any single-pixel erroneous measurements, 
determining whether the isolated view includes an image of a person; 
determining a horizontal extent of a torso in the image of the person so as to isolate 
10 arm portions of the person in frames of the captured video sequence; 

computing arm angles by calculating angles of principle moment of nonzero pixels 
in the arm portions of the image of the person; and 

generating an arm position data signal responsive to arm angles for effecting one of 
translational movement, rotational movement, and both translational and rotational 
15 movement of an object on a graphical display. 

29. (New) A method for generating signals to effect one of translational 
movement, rotational movement, and both translational and rotational movements of an 
object on a graphical display using one of human arm position data, human arm movement 
20 data, and both human arm position and movement data, comprising: 

providing an image processor and a device for capturing a video sequence; 
capturing, from the video sequence, a frame that does not include a person; 
isolating a view comprising a foreground subject image view by performing an 
algorithm on the video sequence and the frame that does not include the person; 
25 determining whether the isolated view includes an image of a person; 
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determining a horizontal extent of a torso in the image of the person so as to isolate 
arm portions of the person in frames of the captured video sequence; 

computing arm angles by calculating angles of principle moment of nonzero pixels 
in the arm portions of the image of the person; and 
5 generating an arm position data signal responsive to arm angles for effecting one of 

translational movement, rotational movement, and both translational and rotational 
movement of an object on a graphical display, wherein the arm position data signal is 
selected from the group consisting of signals related to object airspeed acceleration, bank 
angle, and pitch angle. 

10 

30. (New) A method for generating signals to effect one of translational 
movement, rotational movement, and both translational and rotational movements of an 
object on a graphical display using one of human arm position data, human arm movement 
data, and both human arm position and movement data, comprising: 
15 providing an image processor and a device for capturing a video sequence; 

capturing, from the video sequence, a frame that does not include a person; 

isolating a view comprising a foreground subject image view by performing an 
algorithm on the video sequence and the frame that does not include the person; 

determining whether the isolated view includes an image of a person; 
20 determining a horizontal extent of a torso in the image of the person so as to isolate 

arm portions of the person in frames of the captured video sequence; 

computing arm angles by calculating angles of principle moment of nonzero pixels 
in the arm portions of the image of the person; and 

generating an arm position data signal responsive to arm angles for effecting one of 
25 translational movement, rotational movement, and both translational and rotational 
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movement of an object on a graphical display, wherein the arm position data signal is 
determined with the inclusion of smoothing constants. 

31. (New) A method for generating signals for use in a flight simulator 
5 graphical display using human arm position data to effect one of translational movement, 

rotational movement, and both translational and rotational movement of an object defined 
as a flying creature that moves wings, comprising: 

providing a device for capturing video images and an image processor; 

capturing video images with the device, the video images including an image of a 
10 background without a human form and an image of a background with a human form; 

using the image processor to process the captured video images to isolate the 
human form from the background; 

isolating arm portions of the human form from a captured video image using the 
image processor; 

15 calculating arm position and movement data using the image processor; 

generating a signal responsive to the arm position and movement data using the 
image processor for use in generating a state of a flight simulator graphical display; and 

generating flapping noises corresponding to movement of the wings of the flying 
creature. 

20 

32. (New) A method for generating signals for use in a flight simulator 
graphical display using human arm position data to effect one of translational movement, 
rotational movement, and both translational and rotational movement of an object defined 
as a flying creature that moves wings, comprising: 

25 providing a device for capturing video images and an image processor; 
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capturing video images with the device, the video images including an image of a 
background without a human form and an image of a background with a human form; 

using the image processor to process the captured video images to isolate the 
human form from the background; 
5 isolating arm portions of the human form from a captured video image using the 

image processor; 

calculating arm position and movement data using the image processor; 

generating a signal responsive to the arm position and movement data using the 
image processor for use in generating a state of a flight simulator graphical display; and 
10 generating flapping noises corresponding to movement of the wings of the flying creature, 
wherein a volume of the flapping noises increases with an increased rate of arm motion. 

33. (New) A method for generating signals for use in a flight simulator 
graphical display using human arm position data to effect one of translational movement, 
15 rotational movement, and both translational and rotational movement of an object defined 
as a flying creature that moves wings, comprising: 

providing a device for capturing video images and an image processor; 

capturing video images with the device, the video images including an image of a 
background without a human form and an image of a background with a human form; 
20 using the image processor to process the captured video images to isolate the 

human form from the background; 

isolating arm portions of the human form from a captured video image using the 
image processor; 

calculating arm position and movement data using the image processor; 
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generating a signal responsive to the arm position and movement data using the 
image processor for use in generating a state of a flight simulator graphical display; and 
generating flapping noises corresponding to movement of the wings of the flying creature, 
wherein the flapping noises are triggered when a signed time rate of change of an average 
5 of arm angles exceeds a pre-determined threshold. 

34. (New) A method for generating signals for use in a flight simulator 
graphical display using human arm position data to effect one of translational movement, 
rotational movement, and both translational and rotational movement, wherein the flight 
10 simulator graphical display includes as an object a flying creature that moves wings, 
comprising: 

providing a device for capturing video images and an image processor; 
capturing video images with the device; 

using the image processor to process the captured video images to isolate a human 
15 form from a background; 

isolating arm portions of the human form from a captured video image using the 
image processor; 

calculating arm position and movement data using the image processor; 
generating a signal responsive to the arm position and movement data using the 
20 image processor, the signal to be used in generating a state of the flight simulator graphical 
display; and 

generating flapping noises corresponding to a movement of the wings of the flying 
creature. 
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35. (New) A method for generating signals for use in a flight simulator 
graphical display using human arm position data to effect one of translational movement, 
rotational movement, and both translational and rotational movement, wherein the flight 
simulator graphical display includes as an object a flying creature that moves wings, 
5 comprising: 

providing a device for capturing video images and an image processor; 
capturing video images with the device; 

using the image processor to process the captured video images to isolate a human 
form from a background; 
10 isolating arm portions of the human form from a captured video image using the 

image processor; 

calculating arm position and movement data using the image processor; 
generating a signal responsive to the arm position and movement data using the 
image processor, the signal to be used in generating a state of the flight simulator graphical 
15 display; and 

generating flapping noises corresponding to a movement of the wings of the flying 
creature, wherein a volume of the flapping noises increases with an increased rate of arm 
motion. 

20 36. (New) A method for generating signals for use in a flight simulator 

graphical display using human arm position data to effect one of translational movement, 
rotational movement, and both translational and rotational movement, wherein the flight 
simulator graphical display includes as an object a flying creature that moves wings, 
comprising: 

25 providing a device for capturing video images and an image processor; 
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capturing video images with the device; 

using the image processor to process the captured video images to isolate a human 
form from a background; 

isolating arm portions of the human form from a captured video image using the 
5 image processor; 

calculating arm position and movement data using the image processor; 

generating a signal responsive to the arm position and movement data using the 
image processor, the signal to be used in generating a state of the flight simulator graphical 
display; and 

10 generating flapping noises corresponding to a movement of the wings of the flying 

creature, wherein the flapping noises are triggered when a signed time rate of change of an 
average of calculated arm angles exceeds a pre-determined threshold. 
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